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Abstract 

In this talk I will presente the physical meaning of replica symmetry breaking stressing the 
physical concepts. After introducing the theoretical framework and the experimental evidence 
for replica symmetry breaking, I will describe some of the basic ideas using a probabilistic 
language. The predictions for off-equilibrium dynamics will be shortly outlined. 

1 Introduction 

In this talk I will underline the physical meaning of replica symmetry breaking [||, ^, ^. I will 
stress the physical concepts and I will skip most of the technical details. It is an hard job 
because the field has grown in a significant way in the last twenty years and many results are 
available. 

I will try to make a selection of the most significant results, which is however partly arbitrary 
and incomplete. The main points I would like to discuss are: 

• Complex Systems: the coexistence of many phases. 

• The definition of the overlap and its probabilities distributions. 

• Experimental evidence of replica symmetry breaking. 

• High level statistical mechanics. 

• Stochastic stability. 

• Overlap equivalence and ultrametricity. 

• The algebraic replica approach. 

• Off-equilibrium dynamics. 

As you can see from the previous list, in this talk I will try to connect rather different topics 
which can be studied using an unified approach in the replica framework. 
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Figure 1: An artistic view of the free energy of a complex system as function of the configuration 
space. 

2 Complex Systems: the coexistence of many phases 

Boltzmann statistical mechanics can be considered an example of a successful redutionistic pro- 
gram in the sense that it gives an microscopic derivation of the presence of emergent (collective) 
behaviour of a system which has many variables. This phenomenon is known as phase transition. 

If the different phases are separated by a first order transition, just at the phase transition 
point a very interesting phenomenon is present: phase coexistence. This usually happens if we 
tune one parameter: the gas liquid coexistence is present on a line in the pressure- volume plane, 
while the liquid-gas-solid triple point is just a point in this plane. This behaviour is summarized 
by the Gibbs rule which states that, in absence of symmetries, we have to tune n parameters 
in order to have the coexistence of n -|- 1 phases. 

The Gibbs rule is appropriate for many systems, however in the case of complex systems 
we have that the opposite situation is valid: the number of phases is very large (infinite) for 
a generic choice of parameters. This last property may be taken as a definition of a complex 
system. It is usual to assume that all these states are globally very similar: translational 
invariant quantities (e.g. energy) have the same value in all the phases (apart from corrections 
proportional to A^^^/^), this last properties being called phase democracy. These states cannot 
be separated by external parameters coupled to translational invariant quantities, but only by 
comparing one state with an other. 

An example of this phenomenon would be a very long heteropolymer, e.g. a protein or 
RNA, which may folds in many different structures. However quite different foldings may have 
a very similar density. Of course you will discover that two proteins have folded in two different 
structures if we compare them. 

In order to be precise we should consider a large but (finite) system. We want to decompose 
the phase state in valleys (phases, states) separated by barriers [|. If the free energy as function 
of the configuration space has many minima (a corrugated free energy landscape, as shown in 

^For a discussion of the meaning of finite volume states, which are different from infinite volume states Q, see |^]. 
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fig. (|T|)) the number of states will be very large. An analytic and quantitative study of the 
properties of the free energy landscape in a particular model can be found in ^ . 

Let us consider for definitiveness a spin system with N points (spins are labeled by i, which 
in some cases will be a lattice point). 

States (labeled by a) are characterized by different local magnetizations: 

ma{i) = {cr{i))a , (1) 

where (•)q, is the expectation value in the valley labeled by a. The average done with the 
Boltzmann distribution is denoted as (•) and it can be written as linear combinations of the 
averages inside the valleys. We have the relation: 

a 

We can write that the relation 

Wa oc exp{-(3Fa) , (3) 

where by definition is the free energy of the valley labeled by a. 

In the rest of this talk we will call J the control parameters of the systems. The average 
over J will be denoted by a bar (e.g. F). In the cases I will consider here a quenched disorder 
is present: the variables J parametrize the quenched disorder. 

The general problem we face is to find those quantities which do not depend on J and to 
find the probability distribution of those quantities which do depend on J. 



3 The overlap and its probabilities 

As we have already remarked in the case of heteropolymers folding, states may be separated 
making a comparison among them. At this end it is convenient to consider their mutual overlap. 
Given two configurations (cr and r), we define their overlap: 

^[^'^] = ^ E '^(O^(^) ■ (4) 

i=l,N 

The overlap among the states is defined as 

q(.o:,j) = -77 Y1 'ma{i)m^{i) ~ q[(r,T] , (5) 

i=l,N 

where a and r are two generic configurations that belong to the states a and 7 respectively. 

We define Pj{q) as probability distribution of the overlap q at given J, i.e. the histogram 
of q[(7,T] where a and r are two equilibrium configurations. Using eq. (§), one finds that 

= WaW^6{q - qa,'y) , (6) 

a, 7 

where in a finite volume system the delta functions are smoothed. If there is more than one 
state, Pj{q) is not a single delta function 

PM + Hq - Qea) . (7) 

If this happens we say that the replica symmetry is broken: two identical replicas of the same 
system may stay in a quite different state. 
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Figure 2: The function Pj{q) for four different samples (i.e different choices of J) for D = 3 L = 16 
{16^ spins). 



There are many models where the function Pj{q) is non-trivial: a well known example is 
given by Ising spin glasses ||l|, ^, ^. In this case the Hamiltonian is given by 

H = - ^ Ji,kcricrk - ^ /liCJj , (8) 

i,k i 

where a = ±1 are the spins. The variables J are random couplings (e.g. Gaussian or ±1) and 
the variables hi are the magnetic helds, which may be point dependent. 
Let is consider two different models for spin glasses: 

• The Sherrington Kirkpatrick model (infinite range): all N points are connected: Ji^k = 
0{N^^/'^). Eventually N goes to infinity. 

• Short range models: i belongs to a lattice. The interaction is nearest neighbour (the 
variables J are or zero or of order 1) and eventually L goes to infinity at fixed D (e.g. 
D = 3). 

Analytic studies have been done in the case of the SK model, where one can prove rigorously 
that the function Pj{q) is non-trivial. In the finite dimensional case no theorem has been proved 
and in order to answer to the question if the function Pj {q) is trivial we must resort to numerical 
simulations Q or to experiments. 

In fig. (0) we show the numerical simulations for 4 different systems (i.e. different choices 



of the J extracted with the same probability) of size 16 [10|. The slightly asymmetry of the 
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Figure 3: The function P{q) = Pj{q) after average over many samples (D=4, L=3. . . 10) . 

functions is an effect of the finite simulation time. It is evident that the function Pj{q) is non- 
trivial and it looks like a sum a smoothed delta functions. It is also evident that the function 
Pj{q) changes dramatically from system to systems. 

It is interesting to see what happens if we average over the samples. We can this define 



picture holds in D = 3). In this way we obtain a smooth function, with two picks which are 
slightly shifted and becomes sharper and sharper when the size of the system becomes larger. It 
seems quite reasonable that when the system becomes infinite this peak evolves toward a delta 
function which corresponds to the contribution coming from two configurations a and r which 
belongs to the same state. 



4 Experimental evidence of replica symmetry break- 
ing 



Replica symmetry breaking affects the equilibrium properties of the system and in particular 
the magnetic susceptibility. For example let us consider a system in presence of an external 
constant magnetic field, with Hamiltonian given by: 



As soon as replica symmetry is broken we can define two magnetic susceptibilities which are 
different: 
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Figure 4: FC- and ZFC-magnetisation (higher and lower curve respectively) vs. temperature of 
Cu(Mnl3.5%), H =1 Oe (taken from For a such a low field the magnetization is proportional 
to the susceptibility. 



• The magnetic susceptibility that we obtain when the system is constrained to remain in a 
vaUey In the hmit of zero magnetic field this susceptibility is given by xlr = — Qea)- 

• The total susceptibility magnetic susceptibility (the system is allowed to change state as 
an effect of the magnetic field). In the limit of zero magnetic field this susceptibility is 
given by Xeq = P J dq P{q){l - q) < /3(1 - qsA) ■ 

Both susceptibilities are experimentally observable. 

• The first susceptibly is the susceptibly that you measure if you add an very small magnetic 
field at low temperature. The field should be small enough in order to neglect non-linear 
eff'ects. In this situation, when we change the magnetic field, the system remains inside a 
given state and it is not forced to jump from a state to an other state and we measure the 
ZFC (zero field cooled) susceptibility, that corresponds to xlr- 

• The second susceptibility can be approximately measured doing a cooling in presence of 
a small field: in this case the system has the ability to chose the state which is most 
appropriate in presence of the applied field. This susceptibility, the so called FC (field 
cooled) susceptibility is nearly independent from the temperature and corresponds to Xeq- 

Therefore one can identify xlr and Xeq with the ZFC susceptibility and with the FC sus- 
ceptibility respectively. The experimental plot of the two susceptibilities is shown in fig. (Q). 
They are clearly equal in the high temperature phase while they differ in the low temperature 
phase. 

The difference among the two susceptibilities is a crucial signature of replica symmetry 
breaking and, as far as I known, can explained only in this framework. This phenomenon is due 
to the fact that a small change in the magnetic field pushes the system in a slightly metastable 
state, which may decay only with a very long time scale. This may happens only if there are 
many states which differs one from the other by a very small amount in free energy. 
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5 The theoretical framework 



The general theoretical problem we face is to find out which is the probability distribution of 
the set of all Qa^-y and (or equivalently Wa)- More precisely for each given and J we 
call P the set of all qa,-y and F^. as we have seen this quantity has strong variations when we 
change the system. We now face the problem of compute the probability distribution of P, that 
we call 'P(P). Moreover it should be clear that also when P(P) is known the computation of 
the average of some quantities over this distribution is non-trivial because for large systems P 
contains an unbounded number of variables. The task of doing these kind of averages we can 
regarded as a sort of high level (macroscopic) statistical mechanics [ 12 1 , where the basic entities 
are the phases of the system, while the usual statistical mechanics can be thought as low level 
(microscopic) statistical mechanics 0. 

The number of possible form of the probability distribution 'P(P) is very high (P is an 
infinite dimensional vector). In order to reduce the number of possible distributions one usually 
uses some general guiding principles. The simplest theory is based on two principles: 

• Stochastic stability 



Overlap equivalence 16 1. 



Stochastic stability is nearly automatically implemented in the algebraic replica approach 
that will be described in the next section and it seems to be a rather compulsory property in 
equilibrium statistical mechanics. Overlap equivalence is usually implemented in the algebraic 
replica approach, but is certainly less compulsory than stochastic stability. 



5.1 Stochastic stability 

In the nutshell stochastic stability states that the system we are considering behaves like a 
generic random system. Technically speaking in order to formulate stochastic stability we have 
to consider the statistical properties of the system with Hamiltonian given by the original 
Hamiltonian (H) plus a random perturbation (Hr): 

H{e) =H + eHR. (12) 

Stochastic stability states that all the properties of the system are smooth functions of e around 
e = 0, after doing the appropriate averages over the original Hamiltonian and the random 
Hamiltonian. 

Typical examples of random perturbations perturbations (we can chose the value of r in an 
arbitrary way): 

i\...ir 

where for simplicity we can restrict ourselves to the case where the variables R are random 
uncorrelated Gaussian variables. For r = 1 this perturbation corresponds to adding a random 
magnetic field: 

H^^^ =Y,R{h)a{h) . (14) 

ii 

Stochastic stability is non-trivial statement: when we add a perturbation the weight of the 
states changes of an amount that diverges when N goes to infinity at fixed e. Indeed the 
variation in the individual free energies is given by 5Fo, = 0{eN^I^) . 

^The words "low level" and "high level" are used in the same spirit as "low level language" and "high level language" 
in computer science. 
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Figure 5: The quantity (g^)^ — {^{q'^) + |('?^) ) as function of the temperature for different values of 
L in D = 3. 



It useful to remark that if a symmetry is present, a system cannot be stochastically stable. 
Indeed spin glasses may be stochastically stable only in the presence of a finite, non-zero mag- 
netic field which breaks the a <-> —a symmetry. If a symmetry is present, stochastic stability 
may be valid only for those quantities which are invariant under the action of the symmetry 
group. It is also remarkable that the union of two non-trivial uncoupled stochastically stable 
systems is not stochastically stable. Therefore a non-trivial stochastically stable system cannot 
be decomposed as the union of two or more parts whose interaction can be neglected. 

We will now give an example of the predictive power of stochastic stability |l^] . 

There are systems in which the replica symmetry is broken at one-step. In other words in 
thus kind of systems the overlap may take only two values: 

qa,a = qi= QEA, Qa^ = QO for O / 7 . (15) 

This is the simplest situation: all pairs of different states have the same (i.e. qq) mutual 
overlap, which for simplicity we will take equal to zero. The only quantity we have to determine 
is the probability of the free energies. The free energies are assumed to be random uncorrelated 
variables and the the probability of having a state with total free energy in the interval [F, F+dF] 
is 

p{F)dF . (16) 

Stochastic stability implies that in the region which is dominant for the thermodynamic quan- 
tities, i.e. for the states having not too high free energy: 

piF) a exp(/3m(F - Fq)) , (17) 

where Fq a system dependent reference free energy, proportional to A^. As a byproduct the 
function P{q) can be magnetisations computed and is given by 

Piq) = m5{q) + (1 - m)5{q - qEA) ■ (18) 

The proof of the previous statement is rather simple [|l8| . Stochastic stability imposes that 
the form of the function p{F) remains unchanged (apart from a possible shift in Fq) when one 
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Figure 6: The quantities (g^)^ and ^{q'^) + |(?^) as function of the temperature for different values 
of L in D = 3. 



adds a small random perturbation. Let us consider the effect of a perturbation of strength e on 
the free energy of a state, say a. The unperturbed value of the free energy is denoted by Fa- 
The new value of the free energy Ga is given by 



Get — + srQ, , 



(19) 



where are identically distributed uncorrelated random numbers. Stochastic stability implies 
that the distribution p{G) is the same as p{F). Expanding to second order in e we get: 



dp cPp 



(20) 



Therefore p{F) oc exp(/3m(F — Fq)). 

In the general case stochastic stability implies that 



P{qi,q2)=Pj{qi)Pj{q2) 



\p{qi)P{q2) + \p{qi)5{qi 



q2) 



A particular case of the previous relation is the following one 

1- 



(21) 



(22) 



We have tested the previous relations in three dimensions as function of the temperature at 

2 

different values of L [^. In fig. ^ we plot the quantity (g^)^ — (5(9^) + 1(9^) )) which should 
be equal to zero. Indeed it is very small and its values decreases with L. In order to give a more 
precise idea of the accuracy of stochastic stability in fig. (P) we plot separately the quantities 

2 

(g^)-^ and ^(g^) + §(9^) • The two quantities cannot be distinguished on this scale and in the 
low temperature region each of them is a factor of 10^ bigger of their difference. I believe that 
there should be few doubts on the fact that stochastic stability is satisfied for three dimensional 



spin glasses |l^ . 
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5.2 Overlap equivalence and ultrametricity 

In the case in which the overlap may take three or more values, stochastic stability apparently 
does not fix the probability distribution. A further general principle may be useful in order to 
get new constraints. This principle is overlap equivalence. 

In order to formulate the principle of overlap equivalence it is convenient to introduce a 
generalized overlap. Let A{i) be a local quantity. We define: 

qi^ = N~'J2iMi))a{A{r)), . (23) 

i 

Let us consider two possibilities: 

• For A{i) = a{i) we get the usual overlap: = q. 

• For A{i) = H{i) we get the usual energy overlap: = . 

If we consider also the generalized overlaps we have that the description of a system is much 
more involved: we have to specify the Wa and the g^,^ for all possible choices of A. In the 
general case an infinite number of quantities (i.e. for all choices of A) characterizes the 



mutual relations among the state a and the state 7 [l^, y]. 

Overlap equivalence states that this infinite number of different overlaps is reduced to one 
(the usual overlap) 1^, 15]. There is only one significant overlap and all overlaps (depending 



on the operator A) are given functions of the spin overlap. For any choices of A there is a 
corresponding function f^{q) such that q^,^ = f^{qa,-t)- 

Overlap equivalence may be also formulated if we define the g-restricted ensemble: 

(/(a, r)), « /(^' ■^)^(^^ - ^]) • (24) 

fJ.T 

Overlap equivalence implies the validity of cluster decomposition in the g-restricted ensembles. 

Overlap equivalence (plus stochastic stability) seems [|l^ to imply the ultrametricity condi- 
tion 

qa,^>Tcmi{qa^l3,qp^^) \/(3. (25) 
If ultrametricity is valid, one finds that 

P^^'^^'^\qi2,q23,q3i) = , (26) 
as soon as one of the three ultrametricity relations, 

qi2 > min(g23,93i) ,923 > min(g3i,gi2) ,931 > min(gi2,g23) , (27) 

is not satisfied. 

It is remarkable that, given the function P{q), the ultrametricity condition completely de- 
termines the probability pi2,23,3i^ j£ assume stochastic stability. Overlap equivalence may 
be less compulsory of stochastic stability. There are some indications |^] for its validity in 
the finite dimensional case (i.e. beyond mean field theory), but they are no so strong as for 
stochastic stability. 

6 The algebraic replica approach 

The algebraic replica approach is a compact way to code all the previous information into a 



matrix and also to compute the free energy [Q, 15 1 
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A crucial role is played by a matrix Qa,b which is said to be a x matrix. The direct 

(n) 

definition of a x matrix may be not too easy. Instead we can consider a family ^ of nx n 
matrices which depend analytically on n: they are defined for n multiple than M in such a 
way that the analytic continuation of some scalar functions of these matrices at n = is well 
defined. 

In this formulation the probability (after average over the permutation of lines and columns 
of the matrix) that an element of the matrix Qa,b with a ^ b is equal to q, coincides with the 
function P{q) = Pj{q)- 

-f (?) = WaW^5{q - qa,j) = lini '^^ ■ (28) 

^-^ n-*o n{n — 1) 

Q!,7 \ ' 

In the same way the probability that an element of the matrix {Qa,b) is equal to qi and 
an other element of the matrix {Qc,d) is equal to q2 (with a, b, c and d different) give us 
P{qi,q2)=Pj{qi)Pj{q2y. 

T..b,c4^(Q<^<b - qi)SiQc,d - 92) 



P{qi,q2) = WaWpw^WeSiqi - qa,f3)5iq2 - q-t,e) = lim 



n^o n(n - l)(n - 2)(n - 3) 

(29) 

In this approach probability statements become algebraic statements. 

• Stochastic stability becomes the statement that one line of the matrix is a permutation of 
an other line of the matrix. 

• Overlap equivalence is a equivalent to more complex statement: if there are four indices 
(a. 6, c and d) such that Qa,h = Qc,d, there is a permutation vr that leaves the matrix 
unchanged {Qa,b = QTT{a),-n{b)) ^'^^ brings a in c and 6 in d (i.e. 7r(a) = c and 7r(6) = d). 

As you see in the algebraic approach one uses a quite different (and more abstract) language 
from the probabilistic approach. Using this language computations are often more simple and 
compact. 



7 OfF-equilibrium dynamics 

The general problem that we face is to find what happens if the system is carried in a slightly 
off equilibrium situation. The are are two ways in which this can be done. 

• We rapidly cool the system starting from a random (high temperature) configuration at 
time zero and we wait a time much larger than the microscopical one. The system orders 
at distances smaller that a coherence distance ^(t) (which eventually diverges when t goes 
to infinity) but remains always disordered at distances larger than 5,{t). 

• A second possibility consists in forcing the system in on off-equilibrium state by gently 
shaking it. This can be done for example by adding a small time dependent magnetic field, 
which should however strong enough to force a large scale rearrangement of the system 




In the first case we have the phenomenon of ageing. This effects may be evidenziated if we 
define a two time correlation function and two time relaxation functions (we cool the system at 
time 0) |]20| , The correlation function is defined to be 

1 ^ 

C{t,t^) = —Y.^ai{t^)a,{t^ + t)), (30) 

i=l 
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Figure 7: The correlation function for spin glasses as function of time t at different tw 

which is equal to the overlap q{tw,tyj + t) among a configuration at time tyj and one at time 
t"w "I" t- The relaxation function S(t^ t^j ) is a just given by 

P lim 77 , (31) 

<5/i->o on 

where 5m is the variation of the magnetization when we add a magnetic field 5h starting from 
time tu,. More generally we can introduce the time dependent Hamiltonian: 

H = Ho + 9{t- t^) hi(Ti . (32) 

i 

The relaxation function is thus defined as: 
We can distinguish two situations 

• For t << we stay in the quasi-equilibrium" regime ||2^, C{t,tw) — Ccq{t) , where Ceq(t) 
is the equilibrium correlation function; in this case qea = hm^^oo hm(^_^oo C{t, t^)- 

• For t = 0(tii,) or larger we stay in the aging regime. In the case where simple aging holds, 
C{t,tw) oc C{t/tw)- A plot of the correlation function for spin glasses at different t^ is 
shown in fig. @. 

In the equilibrium regime, if we plot parametrically the relaxation function as function of 
the correlation, we find that 

<-> 

which is a compact way of writing the fiuctuation-dissipation theorem. 
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Figure 8: Three different form of tlie function P{q) and the related function S{q). Delta functions 
are represented ClS db vertical arrow 



Generally speaking the fluctuation-dissipation theorem is not valid in the ofF-equilibrium 
regime. In this case one can use stochastic stability to derive a relation a among statics properties 
and the form of the function S{C) measured in off-equilibrium |2C, 21, O]: 



dS_ 
dC 



dqP{q)^X{C) . (35) 

Jo 



In fig. (|8|) we show three main different kinds of dynamical response S{C), that correspond 
to different shapes of the static P{q) (which in the case of spin glasses at zero magnetic field 
should be replaced by Pd^D). Case A correspond to systems where replica symmetry is not 
broken, case B to one step replica symmetry breaking, which should be present in structural 
glasses and case C to continuous replica symmetry breaking, which is present in spin glasses. 

The validity of these relation has been intensively checked in numerical experiments (see for 
example fig. (|9|)). 

In spin glasses the relaxation function has been experimentally measured many times in the 
aging regime, while the correlation function has not yet been measured: it would be a much 
more difficult experiment in which one has to measure thermal fiuctuations. Fortunately enough 
measurements of both quantities for spin glasses are in now progress. It would be extremely 
interesting to see if they agree with the theoretical predictions. 

For reasons os time I shall not discuss the generalization of the previous arguments to the 
case of a spin glass in presence of a time dependent magnetic field. I only remark that in this 
case the correlation function is directly related to the Birkhausen noise, which as far a I know, 
has never been measured in spin glasses. 
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Figure 9: Relaxation function versus correlation in the Edwards-Anderson (EA) model in D = 3 
T = 0.7 ~ |Tc and theoretical predictions from eq. (|35D . 



8 Conclusions 

In this talk I have presented a review of the basic ideas in the mean field approach to spin 
glasses. There are many points which I have not covered and are very important. Let me just 
mention some of them; 

• The analytic studies of the corrections to mean field theory. 

• The purely dynamical approach which can be used without any reference to equilibrium. 

• The extension of these ideas to other disorder systems, to neural network and in general 
to the problem of learning. 

• The relevance of this approach for biological systems, both at the molecular level and at 
the systemic level. 

• The extension of these ideas to systems in which quenched disorder is absent, e.g. struc- 
tural glasses [p^ ]. 
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